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(57) Abstract: A system for estimating the recipe of a dish under cooking with high acciuacy by specifying the foodstuff and the 
cooking operation for the foodstuff with high accuracy. The systan for recognizing cooking operation of foodstuff comprises; a 
sensing section (200) provided with an optical camera (10) for photographing the cooking situation of a cook, a thermal camera (20), 
and a microphone (30) for acquiring enviiomnental sound; a section (106) for making a feature amount template fix>m a foodstuff 
database, a cooking material database (104X and a cooking operation database (105), and a recognition processing section (1 10) for 
calculating the degree of obso^tion confidence of the foodstuff being cooked and cooking operation of a cook based on observation 
data acquired at the sensing section (200), making a cooking flow based on the degree of observation confidence, calculating the 
adaptability of the cooking flow thus made based on the degree of confidence of template written on the feature amount template, 
and recognizing the foodstuff, cooking operation and cooking recipe. 
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